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INVERSE HALFTONING FOR MULTI-LEVEL HALFTONES 

Inventor: Anoop K. Bhattacharjya 

BACKGROUND OF THE INVENTION 

Field of the Invention 

This invention relates to techniques for recovering an original image from its 
halftone version. The techniques may be implemented in an apparatus, as 
methods, or as programs of instructions for directing an apparatus or machine to 
carry out the processing steps of these techniques. 

Description of the Related Art 

Continuous tone images are converted to halftone images for printing. 
Halftones are binary or multi-level images, and bi- or multi-level dithering used to 
generate them creates the effect of continuous tones by trading off color depth 
against spatial resolution. While halftones are excellent for printing, they do not 
lend themselves well to certain processing, such as scaling or enhancement. 
Halftones are also not very compressible. Thus, a halftone is normally reconverted 
to a continuous tone image to enable such processing and then converted back to a 
halftone before printing. 

One known and relatively simple way to reconstruct an original image from 
its halftone version involves applying a smoothing low-pass filter (LPF) to the half- 
tone version. At each pixel location, the output value of the LPF is kept if the 
absolute color distance between the halftone value and the LPF output value is less 
than a predetermined distance; otherwise, the halftone value is used. 
Mathematically, this simple reconstruction proceeds as follows: 

y = H * y, where H = smoothing LPF 

y if \y-y\< a 

y = 

y if \y-y[>& 
where A = difference between adjacent dither levels 

The problem with this approach is that it tends to introduce blurring into the 
reconstructed image. 
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OBJECTS AND SUMMARY OF THE INVENTION 

Objects of the Invention 

It is an object of the present invention to overcome the aforementioned 
problems. 

5 It is another object of this invention to provide improved techniques for 

reconstructing an original continuous tone image from its halftone version, using 
knowledge about the dither matrix used to generate the halftone, whether the 
halftone was created by bi- or multi-level dithering. 

Summary of the Invention 

10 According to one aspect of this invention, a method is provided for 

reconstructing an image from its halftone version using information obtained from 
%J a dither matrix used to generate the halftone version. The method comprises the 
w steps of: determining a bounding region defined by (x m in, x maJ d for each pixel 
Q location and color value, based on the information obtained from the dither matrix; 
iff applying a low-pass filter to the halftone version, such that for each pixel, the 
CI reconstructed color is (i) the filtered value, if the filtered value is greater than or 
g equal to x m m and less than or equal to x m ax, (ii) the x m i n value, if the filtered value is 
less than x miu , and (iii) the x max value, if the filtered value is greater than x miix . The 
method further comprises, for each pixel, determining whether its value for that 
20 color is to be used in an averaging process based on the distance between the 
bounding region of that pixel and neighborhood pixels' bounding regions. 

In general, Xmin and ^ max define diagonally opposite corners of a color 
hypercube in which the true pixel color is constrained to lie. In the situation where 
the reconstructed color is the filtered value, that value is constrained to lie within 
25 the bounding box defined by * m in and x max . 

The method may further include the step of adding some high frequency 
content to the reconstructed image to increase the perception of detail in the 
reconstruction. A further step of performing color adjustment on the reconstructed 
image may also be included. The color adjustment may be performed using an 
30 inverse look-up table, or a 1-D histogram for each pixel color. 

In another aspect, the invention involves an apparatus on which the above- 
described method may be implemented. The apparatus comprises suitable 
components, as described herein, for carrying out the processing. 
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In accordance with further aspects of the invention, any of the above- 
described methods or steps thereof may be embodied in a program of instructions 
(e.g., software) which may be stored on, or conveyed to, a computer or other 
processor-controlled device for execution. Alternatively, any of the methods or steps 
5 thereof may be implemented using functionally equivalent hardware components, 
or a combination of software and hardware. 

Other objects and attainments together with a fuller understanding of the 
invention will become apparent and appreciated by referring to the following 
description and claims taken in conjunction with the accompanying drawings. 

iif BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram illustrating components in an exemplary image 
n reproduction system that may be used to implement aspects of the present 
y invention. 

Fig. 2(a) is a schematic illustration of a bounding interval along a single color 
IS gradient line in accordance with an embodiment of the invention. 

Fig. 2(b) is a schematic illustration of a bounding box in a 3-D color space in 
Q accordance with an embodiment of the invention. 

Fig. 3 is a block diagram illustrating the color adjustment aspect of the 
invention in accordance with one embodiment. 
20 Fig. 4 is a schematic diagram illustrating the color adjustment aspect of the 

invention in accordance with another- embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 illustrates components in a typical image reproduction system 10 in 
which the techniques of the present invention can be employed. As illustrated in 

25 Fig. 1, the system includes a central processing unit (CPU) 11 that provides 
computing resources and controls the computer. CPU 11 may be implemented with 
a microprocessor or the like, and may also include a graphics processor and/or a 
floating point coprocessor for mathematical computations. System 10 further 
includes system memory 12 which may be in the form of random-access memory 

30 (RAM) and read-only memory (ROM). 

A number of controllers and peripheral devices are also provided, as shown in 
Fig. 1. Each input controller 13 represents an interface to one or more input devices 
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14, such as a keyboard, mouse or stylus. There is also a controller 15 which 
communicates with a scanner 16 or equivalent device. One or more storage 
controllers 17 interface with one or more storage devices 18 each of which includes a 
storage medium such as magnetic tape or disk, or an optical medium that may be 
5 used to record programs of instructions for operating systems, utilities and 
applications which may include embodiments of programs that implement various 
aspects of the present invention. Storage device(s) 18 may also be used to store 
data to be processed in accordance with the invention. A display controller 19 
provides an interface to a display device 21 which may be a cathode ray tube (CRT) or 
16 thin film transistor (TFT) display. A printer controller 22 is also provided for 
communicating with a printer 23 for printing images processed in accordance with 
4 the invention. A communications controller 24 interfaces with a communication 
y device 25 which enables system 10 to connect to remote devices through any of a 
lit variety of networks including the Internet, a local area network (LAN), a wide area 
15 network (WAN), or through suitable electromagnetic carrier signals including 
q infrared signals. 

In the illustrated embodiment, all major system components connect to bus 26 
which may represent more than one physical bus. For example, some personal 
computers incorporate only a so-called Industry Standard Architecture (ISA) bus. 
20 Other computers incorporate an ISA bus as well as a higher bandwidth bus. 

While all processing may occur in the same physical location, such is not a 
requirement of the invention. For example, input or output data may originate or 
terminate at a location remote from processor 11. Also, programs that implement 
various aspects of this invention may be accessed from a remote location (e.g., a 
25 server) over a network. Thus, input or output data, or software embodying a 
program that implements various aspects of the invention may be conveyed to 
processor 11 through any of a variety of machine-readable medium including 
magnetic tape or disk or optical disc, any of which may be used to implement 
system memory 12 or storage device(s) 18, network signals or other suitable 
30 electromagnetic carrier signals including infrared signals. 
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The present invention provides techniques for reconstructing an original 
continuous tone image from its halftone version, using knowledge about the dither 
matrix used to generate the halftone, and is applicable to the reconstruction of bi- 
level and multi-level dithered images. The invention uses an iterative technique to 
5 reconstruct the original from all possible images that are consistent with the given 
halftone scheme. The invention is able to process a halftone generated by any of a 
number of multi-level dithering schemes including one created by a combination of 
bi- and multi-level dithering, such as, for example, by repeatedly applying bi-level 
dithering between closer and closer levels in the multi-level dither until the closest 

10 level is identified. The reconstruction techniques preserve image edges and perform 
image "de-noising" with a single tunable parameter. Reconstruction in the presence 
of additional constraints such as image histograms, or partial block sums can be 
incorporated into the reconstruction techniques. The details of the inverse 

Q halftoning techniques of the present invention are described below. 

11 Knowing the dither matrix, the output value at each pixel location is 
Q constrained to lie within a bounding region given by Omin, *max). The values for x m in 

and Xmax depend on the location of the pixel with respect to the dither matrix (or 
screen) and the dithered value at the pixel. For single-color dithering this defines 
an interval along the color gradient line, as shown schematically in Fig. 2(a). For 

20 multi-color dithering this defines a hypercube or "box" in the image color space 
which may be RGB, CMY, CMYK, etc. Fig. 2(b) schematically illustrates such a 
bounding box 28 in RGB color space. Here, there are three Xmin values, R m in, Gmin 
and Bmin, one for each color dimension and three Xmax values, i? m ax, Gmax and 5 ma x, 
one for each color dimension. The planes defined by the six minimum and 

25 maximum values intersect to form the bounding box 28. The colors (Rmin, Gmin, 
jBmin) and (Rmax, Gmax, B max ) define diagonally opposite corners of box 28. The 
reconstructed pixel color for the pixel at this location is constrained to lie within box 
28. 

A low-pass filter (LPF) is applied to the halftone version, but to improve the 
30 reconstruction, the reconstruction function is constrained to lie within these 
intervals or boxes. At each pixel location, the LPF output value is retained if the 
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halftone value is greater than or equal to x m m and less than or equal to x ma *. The 
xmin value is used if the halftone value is less than x m i n , and the x ma * value is used if 
the halftone value is greater than x max . Mathematically, this process is described as 
follows: 

j = H * y 

Jjf x m <y<x ma![ 

x max ify>x max 

The set of pixels included in the filtering process for the reconstruction of 
color at a given pixel location is determined by the degree of separation between the 
color bounding box for the pixel to be reconstructed and the bounding boxes of all 
pixels in its neighborhood. Only those pixels whose color bounding boxes are 
separated by less than a predetermined threshold are included in the filtering 
computation. This mitigates the problem of image blurring caused by averaging 
colors across region boundaries in an image. Here, the distance between boxes is 
defined to be the shortest distance between a point (P { ) in one box (box x ) and a 
point (P 2 ) in another box (box 2 ) . Mathematically, 

jbox 1 ,box 2 \\ = shortest dist. between P x e box r and P 2 <e box 2 

The distance metric used is Manhattan distance for computational speed. A pixel is 
used in an averaging kernel only if the boxes associated with the output location 
and the location in question have a distance that is less than some specified 
threshold T b0 x, the value of which depends on the particular half-tone scheme used. 

To improve quality some of the high frequency content may be added back to 
the signal, subject to the above constraints, as mathematically described below: 

j = H * y + a(H 2 *y-H*y), 

where H and H 2 represent different filtering kernels and a is a scalar value that 
controls the amount of high-frequency content added to the reconstructed image. 

Next, some color adjustment is preferably performed. This step matches the 
colors in two images, say, imagei and image2, where image2 is obtained after 
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halftoning (with bi-level or multi-level screening) imagei, and applying the above 
reconstruction technique on the halftoned image. The method proceeds by creating 
images of uniform color patches, performing halftoning and reconstruction on these 
color patches and determining the reconstructed color for each patch. A look-up 
5 table is then constructed to match reconstructed colors to their original values. The 
technique is schematically illustrated in Fig. 3. A starting value in each interval, 
e.g., the center value of each interval, is used for the initial estimate. Uniform color 
patches 31 are used as input colors. Multi-level dithering is performed on the colors 
in block 32, and inverse halftoning is done in block 33. An inverse color table is 
1© built that matches the average colors of the output color patches 34 to the input 
u= colors 31. Alternatively, if 1-D histograms representing the distribution of colors in 
the original image are available for each color channel, the centroid of the 
y histogram in each interval can be used as the starting value. The procedure is 
CI schematically illustrated in Fig. 4. Starting interval estimates 41a-41d on a multi- 
it level quantization line 40 correspond to respective interval centroids 44a-44d in 1-D 
histogram 43. 

As the foregoing description demonstrates, the present invention provides 
techniques for recovering an original continuous tone image from its halftone 
version. The invention preserves the quality of the image and also preserves the 

20 ability to mix data from different halftone representations via raster operations. 
The invention has a variety of applications. In particular, the invention may be 
employed in connection with sending images from an image server to hand-held 
devices having different rendering capabilities. A half-tone optimized for the 
rendering capabilities of a particular hand-held device can be created by the server, 

25 compressed and sent to the hand-held device. The compression noise introduced by 
this technique is matched to the rendering algorithm on the output device, and this 
significantly reduces the perception of compression artifacts. The invention is also 
useful in color-depth translations, where an image is transmitted between devices 
having unequal color depths. This may occur, for example, when an image is 

30 wirelessly transmitted from a hand-held device having a relatively low color depth 
to a printer having a higher color depth. 
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The techniques of the present invention may be conveniently implemented 
using software running on a personal computer or other processing device, as 
previously described. The techniques of the present invention may also be 
implemented with functionally equivalent hardware components, such as one or 

5 more application specific integrated circuits (ASICs), digital signal processors, or 
the like. A combination of software and hardware may also be used to implement 
the techniques of the present invention. With these implementation alternatives in 
mind, it is to be understood that the figures and accompanying description provide 

^ the functional information one skilled in the art would require to write program 
1§ code (i.e., software) or to fabricate circuits (i.e., hardware) to perform the processing 

M' required. 

ill 

While the invention has been described in conjunction with several specific 
embodiments, many further alternatives, modifications, variations and applications 
ij will be apparent to those skilled in the art that in light of the foregoing description. 
i?f Thus, the invention described herein is intended to embrace all such alternatives, 
□ modifications, variations and applications as may fall within the spirit and scope of 
the appended claims. 
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